Seeing a singer helps comprehension of the song's lyrics.
نویسندگان
چکیده
When listening to speech, we often benefit when also seeing the speaker's face. If this advantage is not domain specific for speech, the recognition of sung lyrics should also benefit from seeing the singer's face. By independently varying the sight and sound of the lyrics, we found a substantial comprehension benefit of seeing a singer. This benefit was robust across participants, lyrics, and repetition of the test materials. This benefit was much larger than the benefit for sung lyrics obtained in previous research, which had not provided the visual information normally present in singing. Given that the comprehension of sung lyrics benefits from seeing the singer, just like speech comprehension benefits from seeing the speaker, both speech and music perception appear to be multisensory processes.
منابع مشابه
Read my lips: speech distortions in musical lyrics can be overcome (slightly) by facial information
Understanding the lyrics of many contemporary songs is difficult, and an earlier study [Hidalgo-Barnes, M., Massaro, D.W., 2007. Read my lips: an animated face helps communicate musical lyrics. Psychomusicology 19, 3–12] showed a benefit for lyrics recognition when seeing a computer-animated talking head (Baldi ) mouthing the lyrics along with hearing the singer. However, the contribution of vi...
متن کاملAccepted Manuscript Accepted Manuscript Read My Lips: Speech Distortions in Musical Lyrics Can Be Overcome (slightly) by Facial Information
Understanding the lyrics of many contemporary songs is difficult, and an earlier study (Hidalgo-Barnes and Massaro, 2007) showed a benefit for lyrics recognition when seeing a computer-animated talking head (Baldi®), mouthing the lyrics along with hearing the singer. However, the contribution of visual information was relatively small compared to what is usually found for speech. In the current...
متن کاملRevisiting the dissociation between singing and speaking in expressive aphasia.
We investigated the production of sung and spoken utterances in a non-fluent patient, C.C., who had a severe expressive aphasia following a right-hemisphere stroke, but whose language comprehension and memory were relatively preserved. In experiment 1, C.C. repeated familiar song excerpts under four different conditions: spoken lyrics, sung lyrics on original melody, lyrics sung on new but fami...
متن کاملVocaRefiner: An Interactive Singing Recording System with Integration of Multiple Singing Recordings
This paper presents a singing recording system, VocaRefiner, that enables a singer to make a better singing recording by integrating multiple recordings of a song he or she has sung repeatedly. It features a function called clickable lyrics, with which the singer can click a word in the displayed lyrics to start recording from that word. Clickable lyrics facilitate efficient multiple recordings...
متن کاملApplication of Frame Semantics to Teaching Seeing and Hearing Vocabulary to Iranian EFL Learners
A term in one language rarely has an absolute synonymous meaning in the same language; besides, it rarely has an equivalent meaning in an L2. English synonyms of seeing and hearing are particularly grammatically and semantically different. Frame semantics is a good tool for discovering differences between synonymous words in L2 and differences between supposed L1 and L2 equivalents. Vocabulary ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Psychonomic bulletin & review
دوره 17 3 شماره
صفحات -
تاریخ انتشار 2010